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Abstract 

Potential games, originally introduced in the early 1990’s by Lloyd 
Shapley, the 2012 Nobel Laureate in Economics, and his colleague Dov 
Monderer, are a very important class of models in game theory. They 
have special properties such as the existence of Nash equilibria in pure 
strategies. This note introduces graphical versions of potential games. 
Special cases of graphical potential games have already found applicabil¬ 
ity in many areas of science and engineering beyond economics, includ¬ 
ing artificial intelligence, computer vision, and machine learning. They 
have been effectively applied to the study and solution of important real- 
world problems such as routing and congestion in networks, distributed 
resource allocation (e.g., public goods), and relaxation-labeling for im¬ 
age segmentation. Implicit use of graphical potential games goes back 
at least 40 years. Several classes of games considered standard in the 
literature, including coordination games, local interaction games, lattice 
games, congestion games, and party-affiliation games, are instances of 
graphical potential games. This note provides several characterizations 
of graphical potential games by leveraging well-known results from the 
literature on probabilistic graphical models. A major contribution of the 
work presented here that particularly distinguishes it from previous work 
is establishing that the convergence of certain type of game-playing rules 
implies that the agents/players must be embedded in some graphical po¬ 
tential game. 


1 Introduction 

Potential games [Monderer and Shaplevl . 1996j] have become an inherently im¬ 
portant class of models in game theory. Potential games have special properties 
such as the existence of Nash equilibria in pure strategies. By now, potential 
games are so fundamental and core to game theory that their study is of broad 
interest. 

This note introduces graphical potential games, a graphical version of clas¬ 
sical potential games. Implicit use of graphical potential games goes back at 
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least 40 years. Special cases of graphical potential games have already found 
applicability in many areas of science and engineering beyond eco no mics . These 


areas include artificial i n telligence and comput er vision Miller and Zuckeijjl991 


Yu and Berthod . 19951 Berthodet ah ^ 19961. machine learning Rezek et al 


neural networks Hopheld, 1982 . Miller and Zuckeil 1991 [, theoretical 


computer sc ience, computational social science and sociology IMonta nari an d Saberi 
200a 2010| |. and dynamical systems Miller and Zuckeil 1991 . Zucker . 2001 1. 


They have been effectively applied to the study and solution of im portant 
real-world problems such as routing and congestion in networks 
19731 . distributed resource allocation such as public goods 


Heikkincn, 


Rosenthal, 

2006!. 


relaxation-labeling for image segmentation Roscnfcld et al., 1976, Mi ller and Zucker 


1991 


Zucker . 2001 . Yu and Berthodl . [l995 . Berthod et all Il996j ■ c lustering and 


p roba bilistic inference in graphical models via learning in games [Rezek et al 


2008j | . equilibrium-selection in strategic settings Yound . 1993 1, the em ergence of 


coordination from individual agent’s strategic behavior Blume, 1995], the rate 


at which innovations and norms/conv entions spread through a social ne twork 
and the role of the network st ructure iMontanari and Saberi . 20091 . 2010( | . and 
inference in Hopfield networks [Hopfieldl . Il982l ]. tPlease refer to the given refer¬ 
ence for details.) Several classes of games considered sta ndard in the li terature , 
including c oordination ga mes, local inte raction games IMontanari and Saberi . 
2009, 2010], lattice games Blumel. 19931. congestio n games RosenthajT 19731] . 


Fabrikant et all 120041 ] . are instances of graphical 


and party-affiliation games 
potential games. 

Potential games, like normal-form games, do not have an inh eren tly compact, 
graphical representation, in contrast to graphical games Kearns et all 12001 1. 
Not all potential games are non-trivial graphical games. In a graphical game, 
the payoff function of each player is a function of its neighbors in the game 
graph. Any definition of a graphical game must respect that. But the potential 
function of a potential game is global: it involves all players! That means 
that we can only use certain types of potential functions to define a graphical 
potential game. 

This note provides several, strong characterizations of graphical potential 
games by leveraging well-known results from the literature on probabilistic 
graphical models. A major contribution of the work presented here that partic¬ 
ularly distinguishes it from previous work is establishing that the convergence 
of certain type of game-playing rules implies that the agents/players must be 
embedded in some graphical potential game. At this point, it is best to delay 
the discussion of the most closely related work in economics and, more recently, 
computer science until the end of the paper. 


2 Preliminaries 

This section introduces basic notation and concepts in graphical models and 
game theory. 
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Basic Notation. Denote by x = (aq, X 2 , ■ ■ ■, x n ) an n-dimensional vector 
and by X-i = (aq ,... , aq-i, aq+i ,... ,x n ) the same vector without component 
i. Similarly, for every set S C [n] = {1,..., n}, denote by xs = (Xi : i £ S) the 
(sub-)vector formed from x using only components in S, such that, letting S c = 
[n] — S denote the complement of S, we can denote x = ( xs,xs ^) = (. Xi,X-i ) 
for every i. If Ai ,..., A n are sets, denote by A = XjA_,; = x Jg r n ]_{j} Aj 
and A§ — x j g Q /\ -j. 

Graph Terminology and Notation. Let G = (V,E) be an undirected 
graph, with finite set of n vertices or nodes V = [n] and a set of (undirected) 
edges E. For each node i. let Af(i) = {j \ ( i,j ) G E} be the set of neighbors of 
i in G, not including i, and N(i) = A f(i) U {*} the set including i. A clique C 
of G is a set of nodes with the property that they are all mutually connected: 
for all i,j £ C, ( i,j) £ E\ in addition, G is maximal if there is no other node 
k outside G that is also connected to each node in G, i.e., for all k £ V — G, 
(k, i) E for some i £ C. 

Another useful concept in the context of this note is that of hypergraphs, 
which are generalizations of regular graphs. A hypergraph Q = (V, £) is defined 
by a set of nodes V and a set of hyperedges £ C 2 V . We can think of the 
hyperedges as cliques in a regular graph. 


2.1 Graphical Models 

Graphical models [Koller and Friedman , 2009j | are an elegant marriage of statis¬ 
tics and graph theory that has had tremendous impact in the theory and practice 
of modern statistics. It has permitted effective modeling of large, structured 
high-dimensional complex systems found in the real world. The language of 
graphical models allows us to capture the probabilistic structure of complex 
interactions between individual entities in the system. The core component of 
the model is a graph in which each node i corresponds to a random variable Xi 
and missing edges express conditional independence assumptions about those 
random variables in the probabilistic system. 


2.1.1 Markov Random Fields, Gibbs Distributions and the Hammersley- 
Clifford Theorem 

A joint probability distribution P is called a Markov random field (MRF) with 
respect to an undirected graph G if for all x. for every node i, P{Xi = x. t \ X-i = 

X-i) = P(Xi = Xi | Xjq-^ = xjif(i))- In that case, the neighbors/variables Xjg-uj 
form the Markov blanket of node/variable Xi. 

A joint distribution P is called a Gibbs distribution with respect to a an 
undirected graph G if it can be expressed as P(X = x) = Ilcec for some 

functions <l>c indexed by a clique G £ C, the set of all (maximal) cliques in G, 
and mapping every possible value xc that the random variables Xc associated 
with the nodes in G can take to a non-negative number. 
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Let us say that joint probability distribution P is positive if it has full support 
(i.e., P(x) > 0 for all x). 


Theorem 1. [Hammersley-Clifford] tHammerslev and Clifford . 197 A ] Let P 

be a positive joint probability distribution. Then, P is an MRF with respect to 
G if and only if P is a Gibbs distribution with respect to G. 


In the context of the theorem, the functions <&c are positive, which allows 
us to define MRFs in terms of local potential functions {cfc} over each clique 
C in the graph. Define the function ^(x) = Y^ceC Let us refer to 

any function of this form as a Gibbs potential with respect to G. Thanks to 
the Hammersley-Clifford Theorem, a more familiar expression of an MRF is 
P{X = x) oc exp(£ CgC <t>c(x C )) = exp(^ (a:)). 


2.2 Game Theory and Graphical Games 

Let V = [n] denote a finite set of n players in a game. For each player i £ V, 
let Ai denote the (finite) set of actions or pure strategies that i can play. Let A 
denote the set of joint actions , x = {x-i ,..., x n ) £ A denote a joint action, and 
Xi the individual action of player i in x. Denote by X-i the joint action of all 
the players except i, such that x = (xi, X-f). Let M t : A — ► M denote the payoff 
function of player i. 

There are a variety of compact representations for large g ame i nspired by 
probabilistic graphical models in AI and machine learning La Mura, 12000 


Kearns ct al., 2001, Roller and Milch, 2003, Levton-Brown and Tennenholtz. 2003 


Jian g and Levton-Brow Jl2008j | . This paper’s context is graphical games [Kearns et al 

2001j . a simple but powerful model inspired by probabilistic graphical models 
such as MRFs. 

A graphical game Kearns et all 12001 1 is defined by an undirected graph 
(V, E) and a set of local payoff hypermatrices {M • : A N u\ —>• R | i £ V}. 

Each node i £ V in the graph corresponds to a player in the game and its 
payoff function Mi{x) = Ml(xjfU)) is defined by its local payoff hypermatrix 
M[, a function of the actions of the players in the neig hborhood N(i) of i 
only, which includes i. A hypergraphical game Papadimitrioul 120051 ] is defined 
by a hypergraph (V,£) and sets of “local” payoffs hypermatrices of the form 
{M' i C : Ac —>• M | C € £,i G C}. Let C% = {G € £ \ i e C} be the 
set of cliques in which i participates. The payoff function of player i in a 
hypergraphical game is defined as Mi(x ) = Y^cec ^lc( x c)- Note that the 
payoff function of player i only depends directly on the actions of players in 
its neighborhood N(i) = U nar., C = {? g V I i, 7 g C for some C G £}, which 
includes i. A polymatrix game Janovskaial ll968j | is a hypergraphical game in 
which C = {{i,j} | i,j S V,j i}, which is the set of cliques of pairs of 
nodes involving the player and every other player. If, instead, the hyperedge 
set of each player is some (possibly different) subset of {{z, j} \ j & V,j z}, 
then let us call the game a graphical polymatrix game. Finally, let us say that a 
hypergraphical game is hyperedge-symmetric if, in addition, for every hyperedge 
C containing players i,j in the game, we have that M[ c = M'- c = M' c \ if, in 
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particular, the hypergraphical game is a graphical polymatrix game, then let us 
say that the game is pairwise-symmetric. 


3 Graphical Potential Games 

This section introduces graphical potential games (and other related subclasses) 
and provides some structural properties and characterizations of such games. 
Previous work in probabilistic graphical models facilitate the derivations of the 
results. 


Definition 1. Consider a graph G with (non-inclusive) neighbor sets J\f(i) for 
each payer i. For any graphical game with graph G, and for each player i, 
consider some function fi : R x Aj —>• R. Let us say that the function ft is 
a (conditional) preference-order-preserving transform for player i if ,/) 
is a (strictly) monotonically increasing function of v for every Xjg-r^ £ Aj^-r^ 
Let us call the transform (unconditionally) linear with respect to some positive 
weight Wi if it takes the form fi{v,xjy(if) = WiV. Let us denote by ff 1 the 
corresponding (conditional) inverse function of fi; that is, f~ : R x Ajy^ —> R 
such that for all v € R and Xjyu) £ A^^, we have f(~ 1 (fi{v,Xj^;^),Xjy; i ' > ) = v. 
Denote by f = {fi} and f~ 1 = {ff 1 } the set of preference-order-preserving 
transforms fi and their inverses, respectively, one for each player i. Let us 
say that a function ’P is a /-transformed potential for a graphical game with 
neighbor sets {A/"(*)} and local payoff matrices {Mf} if for all i, Xjy^, and 
x i,x\, M{ (xi , xjy^)) — M[ [x'i , Xjy ;^) = ff'l’ (xi, x-i) - ^ (x}, x-i), xj^ti)) ■ Let us 
call a graphical game with a f-transformed potential a graphical /-transformed 
potential game. 



We can generalize the terminology of lMonderer and Shaplev 1996l| to graph¬ 
ical games. Let w be a positive weight vector. If the transformed fi of each 
player i is (unconditionally) linear with weight Wi, then is called a (weighted) 
w-potential for the game. If Wi = 1 for all i, then ’L is called an (exact) potential. 
Finally, let us say that T is an ordinal potential for a graphical game with neigh¬ 
bor sets {//(*)} and local payoff matrices {M[} if it satisfy the following condi¬ 
tion: Ml(xi,x^ i ))-M' i {x' i ,x^i)) > 0 if and only if 'Sffa, X- i )-'S/{x' i , x^f) > 0 
for all i,Xi,x[ and xjg-^. Let us refer to a graphical game with a (weighted) 
ta-potential, (exact) potential or ordinal potential as a graphical (weighted) w- 
potential, (exact) potential or ordinal potential game , respectively. 


4 Characterizing Graphical Potential Games 

The following theorem characterizes graphical /-transformed potential games: 
the potential function is the sum of local potential functions over each (maximal) 
clique in the game graph. 

' iMonderer and Shaplev! Il996t considered such transforms in the context of (variants of) 
fictitious play. 
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Theorem 2. Every potential of a graphical transformed potential game with 
graph G is a Gibbs potential with respect to G. 

Proof. The proof is based on an application of the Hammersley-Clifford Theo¬ 
rem (Theorem |TJ). Let ^ be the /-transformed potential of the graphical game. 
Define P as a joint probability distribution such that P(X = x) oc exp(\H(x)) 
for all x. (Thus, P is positive.) The following derivation shows that P is an 
MRF with respect to the game graph G: for all i, Xj,x_j, 

P{Xi = Xi | = x-i) 

exp(^(xi,x-j)) 

Ex'^pO^Oo^-i)) 

1 

Ex' ex P (y( x i,x-i) - V{Xi,X-i)) 

1 

Ex' ex P(fr l ( M K x i, x mi)) ~ Mt(xi,xjy (i) ),x jV(i))) 

Hence, by the Hammersley-Clifford Theorem (Theorem [TJ, P is also a Gibbs 
distribution with respect to the graph G of the game. In particular, let C be 
the set of (maximal) cliques of G. There exist a local potential function <f>' c for 
each (maximal) clique C £ C defining a global potential function ’3/' as Uf/x) = 
EceC suc h that P(X = x) oc exp(t[' , (x)). Let Z = Ex ex P( v h(- c )) an d 

Z' = V exp(tf'(®)) he the normalizing constant when expressing P in terms 
of U/ and Hz', respectively, denote by c = \n(Z/Z'), a constant. Then we have 
that for all x, \Iz(x) = 'L'(x) + c. Defining local potential for as, for example, 
<t>c{xc) = <t>c( x ) + c / \C\ completes the proof. □ 

In view of the strong equivalence established by the last theorem, let us 
refer to a graphical transformed potential game as a transformed Gibbs-potential 
game (with the same graph); and similarly for weighted and exact potentials. 
Whether every graphical ordinal potential game has an (equivalent) ordinal 
Gibbs potential is left open. So, let us define an ordinal Gibbs-potential game 
as a graphical game that has a Gibbs potential with respect to the graph of the 
game. 

The following definitions are useful to present the main corollary of the last 
theorem. 

Definition 2. Given an n-dimensional positive weight vector w, let us say that 
a game with payoff hypermatrices {M}} is ui-scaled payoff-difference equivalent 
to another game with the same players and payoff hypermatrices {M?} if for 
all i,X-i,Xi,x' it we have that M/(xi,x_i) — Ml(x(,x_j) = u>j(M?(xj,x_j) — 
M?(x(,x_j)). If ui is the vector of all 1 ’s, then let us simply say that the game 
is payoff-difference equivalent to the other. El 

2 Note that in any two ('iu-scaled) payoff-difference-equivalent games, every player achieves 
exactly the same (tc-scaled) expected regrets with respect to any (fixed, possibly correlated) 
joint-mixed strategy. 
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Definition 3. Let us say that a graph has totally disconnected or open neigh¬ 
borhoods if for every node of the graph, every subgraph induced by the neighbors 
of the node is the empty graph; in other words, there is no edge connecting any 
pair of neighbors of any node in the graph; formally, if E is the edge set, then 
for all i and j, k E N(i),j ^ k, we have (j, k) E. 

Some simple examples of graphs with totally disconnected neighborhoods 
are trees, cycles, and grids. 

Corollary 1. Any w- weighted Gibbs-potential game with graph G and poten¬ 
tial US' is w-scaled pay off-difference equivalent to a hyperedge-symmetric hyper- 
graphical game in which each hyperedge is a (maximal) clique C in G and has 
as corresponding hypermatrix the local potential associated to C in \f'. If, in 
addition, G has totally disconnected neighborhoods then the equivalence is to 
pairwise-symmetric graphical polymatrix games. 0 

It is important to note the implication of the last corollary. In general, there 
is no reason to expect, a priori , just from the definition of a graphical potential 
game with, say for example, a tree graph that the differences in payoff matrix for 
a player would not be arbitrary functions of the action of the player and those 
of its neighbors. The corollary tells us that this is not possible in this case: the 
payoff hypermatrices difference must be sums of simple pairwise matrices, each 
being a simple 2-dinrensional matrix depending on the actions of the player and 
one of its neighbors. The same holds for cycles, grids and similar structures, 
and their corresponding generalizations, including those to higher dimensions. 

The following proposition completes the connection in the reverse direction. 

Proposition 1. Any hyperedge-symmetric hypergraphical game is a graphical 
Gibbs-potential game. 


5 Smooth Best-Response Play and Graphical Gibbs- 
Potential Games 

Let us consider a sequential process of play in which there is a pre-specified order 
by which the players play and at each time step t exactly one player plays by 
choosing an action x\. 0 In the sequel, let us take the sequence of play to be, 
without loss of generality, the sequence 1,2,... ,n. Let us say that a player has 
a (time-homogeneous, first-order) Markov playing scheme if it has a (possibly 
randomized) policy, or plan, by which the agent selects an action based only on 
the last actions played by the other players; more formally, if the policy pi is a 
conditional probability distribution pfxi \ X-f) such that if player i is to play 

3 See Appendix (Missing Proofs) for all missing proofs. 

4 This process may be relaxed to allow certain dynamic variations in the order of play and 
some kinds of simultaneous moves. The process is also related to (smooth versions of) the 
Cournot adjustment process with lock-in and to sto chastic adjustment models in the literature 
on learning in games [Fudenberg and Levinel . 11999 ). 
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at time t + 1 and xM are the last joint-actions that player i observed the others 
take, then player i chooses to play action cc* +1 = Xi with probability pi(xi \ x (_j) 
(i-e-, x‘ +1 ~ pi(. | a:*_*)). @ For a graphical game, let us further say that the 
playing scheme is local if it only depends on the last actions of its neighbors in 
the game graph. 

Property 1. In a graphical game with graph G, the sequential process of play 
generated by Markov playing schemes of the type described above, and that are 
local with respe ct to G, is equivalent to r ealizations generated by running the 
Gibbs sampler \Geman and GemaA . \l98Ji] with conditional distributions given 
by the individual player’s playing scheme. 

For every round r = 1,2,... composed of consecutive time steps of length n, 
denote by z r = (z {,..., zff) the play (joint-action) outcome at round r, so that 
for all i, zf = xf (i.e., the joint-action generated during round r by the 

sequential process of play). Let us refer to the total sequence generated by z r for 
r = 1, 2,..., T as the empirical play up to round T (i.e., after nT rounds). Let us 
say that an empirical play (conditionally) converges starting from an initially 
assigned play x° if the empirical joint-probability distribution defined by the 
empirical play converges (almost surely) to some joint probability distribution 
as we let the sequential process of play run for an infinite number of rounds 
(i.e., for every joint-action x , if we denote the empirical distribution of play 
after T rounds as P T (x) = M zT = x \i then P°°(x) = liniT-s-oo P T (x) 

exists, with probability one.) Let us refer to a set of playing schemes, one for 
each player, as a playing procedure for the game. Furthermore, let us say that 
a playing procedure is consistent (or globally convergent) if the empirical play 
generated is convergent to the same joint distribution P°°(x) from any initial 
joint play x°. 

Let us say that a player i with payoff function Mi uses a smooth best- 
response (SBR) playing scheme pi with respect to a (conditional) preference- 
order-preserving transform /* : R x A_i —> R, if for all X-i, we have pt(xi \ 
X-i) oc exp(fi(Mi(xi,X-i),X-i). If, instead, the ffs above are such that the 
ratio Pi(x.i \ x^/p^xl \ £_,) = exp(f i (M i (x i ,x^i)-M i (x' i ,x_ i ),x_ i )), then let 
us call the scheme a smooth best-response-difference (SBRD) playing scheme. |f| 
Recall from the previous discussion that, for a graphical game, a player’s (play¬ 
ing) scheme is local with respect to the game graph, if it only depends on the 
actions of its neighbors in that graph. In the case of SBR and SBRD schemes, 
in general, this requires that the domain of the second argument to ft be ^4^(0 ■ 
Finally, let us say that the game has a (local, Markov) playing procedure if every 
player uses a (local, Markov) playing scheme. 

The following theorems and corollaries provide another characterization of 
graphical potential games. 

5 Although not pursued in this paper, more complex playing scheme could in principle be 
considered. 

6 This condition implies that f, (v , x _) = -jii—'O, X—i) and Pi(xi \ X—i) = 

VEicl exp (fdMdx'^X-i) - Mi(xi,x-i),x-i)). 
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Theorem 3. Any graphical game with graph G that has a consistent (Markov) 
local SBR playing procedure is an ordinal Gibbs-potential game with graph G. If, 
in particular, the transform fi used by each player i is (unconditionally) linear 
with weight \jwi, then the game is a w-weighted Gibbs-potential game. If the 
playing procedure is SBRD, instead of SBR, then the game is a / -1 -transformed 
Gibbs-potential game, where / -1 denote the inverses of the transforms f used 
by the players for the SBRD scheme. 

Proof. As noted in Property [U the playing procedure is equivalent to the Gibbs 
sampler. The Markov chain associated with the Gibbs sampler is regular be¬ 
cause all the conditional probabilities associated with the players’ schemes are 
positive. Because the procedure is convergent the limiting empirical distribu¬ 
tion of play P is the (unique) MRF consistent with the conditional proba¬ 
bility distributions. Because P is positive, by the Hammersley-Clifford The¬ 
orem (Theorem Q]) , P is also a Gibbs distribution with respect to the graph 
of the game G. Denote by W the Gibbs potential of P. Also, denote by 
Zi(x-i) = J2x'. ex P('^( a: ii x -i)) the normalizing constant for the marginal dis¬ 
tribution over all the variables except i with respect to P. Similarly, denote 
by Zi(xtf(i)) = the normalizing constant of 

the player’s scheme. The conditionals of MRF P must satisfy the following 
condition: 


exp($(a: i , X-j)) 
Zi {%—i ) 


P(Xi — Xi | A —i — X—i'j 

P(Xi = Xi | = %N{i)) 

Pi(Xi | Xjy^) 

exp (fi(M'(xj, XM{i)), X A 

Zi{xjg-(i)) 


From the last equality, we obtain that for all Xi,X-i, 

fi(M-{xi,x A^(i))) = ^(xi,x-i) +\n(Zi(xjy^)/Zi(x-i)) . 


Because the second term on the right hand side of the last equation does not 
depend on X {, we can obtain that for all X-i and every pair Xi,x[, 


fi ( Afj (x% , a-’At(i) ) ) ■DV'(i) ) fi ( i (Xj , ) ) *DvA)) 

= - ^(x'^X-i) . ( 1 ) 


Because the ff s are (strictly) nronotonically increasing with their first argument, 
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we have 


- ^(x'^x-i) > 0 
«=> fi{Ml(xi,x M{i) ),XM {i) )- 
fi {M- [x \, xj^(i )), ajjv(i)) > 0 

<=> fi( M 'i {%i, %M(i)),XAr(i))> fi(Ml(x ', XM(i)),XAf(i)) 
<=> Ml{xi,x M{i) ) > Ml(xi,xjf^) 

^ ^ M-i (xi , a;jv”(«)) (x^, Xj\[(j^) > 0 . 


This completes the proof of the first statement. 

The second statement in the theorem follows by noting that in the case of 
(unconditionally) linear transforms with weight wy. we have that the left-hand 
side of Equation[l] above becomes ft {M[(x t , Xjy^ ),Xjy^)-fi(Ml[x \, Xjy ^), Xjy ^) 
WiMKxuXtfft) - WiM[{x\, ajv(j)) = Wi(Ml(xi,xx(i)) - M'^x'^x^^)). 

The case of SBRD procedure is similar, but simpler: 


exp (fi(Mi(xi,Xtf(i)) - M i (x' i> x^ i) ),x^ i ))) 

_ Pijxi 1 3W(p) 

Pifai I Z/V(i)) 

= exp($(a:i,x_i) - $(a:',a:_i)) . 

Hence, we have M^Xi, xj^^-M^xl, x^f^) = fr 1 (A/(x i ,x_ i )-'S/(x' i , x^). 

Using the definition of a graphical transformed potential game completes the 
proof. □ 

The next proposition completes the characterization of transformed Gibbs- 
potential games as exactly those that have consistent local Markov SBRD play¬ 
ing procedures. 

Proposition 2. Any f-transformed Gibbs-potential game with graph G has a 
consistent Markov SBRD playing procedure that is local with respect to G and 
each player uses the inverse transforms of f in their playing scheme. If, in 
particular, the game is a w-weighted Gibbs-potential game, then it also has an 
SBR procedure with the same properties. 

Whether the last theorem extends to graphical ordinal potential games is 
left open. 


Closing Remarks on Related Work. A connection, obtained indepen¬ 
dently from the one in this paper, between potential ga mes and M R Fs ap¬ 


peared in previous work in economics and game theo ry Ellisonl . ll99.lL Bhrniel . 


Il993l iKandori et al. , 19931 Younsd. 19931 Blume L 19951, and mo re recently in the 
theoretical CS community Montanari and Saberi . 20091 l20icij | . 

In all that previous work, the interest and goal for making the connection 
is different than the one here. Roughly speaking, their connection was via very 
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specific “game-playing rules” (e.g., the logit rule and its limiting version, the so 
called myopic/deterministic/strict best-response rule) on very specific classes of 
games (e.g., coordination games). Their interest was the nature of the steady 
state induced by playing some specific-type of rule in some specific kind of game, 
and some times also establishing bounds on t he convergence rate to steady state 
behavior Montanari and SaberiL 20091 2010]. That previous work showed that 
the steady state of running such a rule in a specific type of graphical game called 
a local interaction game is an MRF with respect to the graph of the specific type 
of game. 

The results presented here are more general in the type of game-playing 
procedures considered for the characterization. This work does not study limit¬ 
ing cases such as (myopic/deterministic/strict) best-response, nor does it study 
convergence rates. 

No previous work provides a connection in the other direction: if certain type 
of game-playing rule converges, then the players must be embedded in some 
graphical potential game. 


1971 


1984]) 


From a technical perspective, by invoking known results_fro_m probabil istic 
graphical models ( e.g., Hammersley-Clifford Theorem Hammersley and Cliffordl . 
esael 1974 1 and convergence of the Gibbs sampler Geman and Gemanl . 
the derivation of our results simplified considerably. Interestingly, the 


proofs for the previous results appear to be specific versions of those typically 
used to prove the “hard” direction of the Hammersley-Clifford Theorem. @ 


A Appendix: Missing Proofs 

This appendix contains all the proofs left out of the main body of the paper. 

A.l Proof of Corollary |l] 

The proof follows from Theorem [2] by applying the respective definitions. For 
the last statement of the corollary, in particular, note that the maximal cliques 
of a graph with disconnected neighborhoods are exactly the edges of the graph. 
Hence, each local potential is pairwise in that case, and the payoff difference is 
the sum of differences of local pairwise potentials, as is the case in any graphical 
polymatrix games, by definition. 

7 A1so, in some cases, the proofs in previous work use more sophisticated mathematical 
tools because they want to understand what happens to the unique stable distribution as the 
best-response becomes deterministic in the limit. They use a dynamical-system framework 
and apply tools such as the Strong Ergodic Theorem to prove the existence of the limit of 
the stable distributions, as th e best-response rul e beco mes more myopic/deterministic/strict. 
The typical reference given is Karli n and Taylon [l975l| . 
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A.2 Proof of Proposition [Tj 

For each hyperedge C in the hypergraphical game, define a corresponding local 
potential <t>c{ x c ) — M ' c {xc ) as the local-clique payoff matrix for C. Defining 
the Gibbs potential using those local potentials and with the graph being the 
primal graph of the hypergraph, which is an undirected graph with the same 
vertex set as the hypergraph but where there is an edge between two nodes if 
there is a hyperedge containing both nodes. [f] 

A.3 Proof of Proposition \ 2 \ 

Let 'I' be the Gibbs potential of the game. Define the SBRD playing scheme for 
each player using the inverse f ~ 1 of the corresponding game transform, such 
that 

Pi{Xj | XM(i)) 

Pi( x i I X A /■(*)) 

= exp(/ i “ 1 (M i (x i ,a:jv( i )) - Xjg^), x M{i) )) 

= exp(^(xi,x_i) - ^(x'.x-i)) 

where the second equality follows from the definition of transformed poten¬ 
tial games. The scheme is local by construction. Because $ is a Gibbs po¬ 
tential, by the Hammersley-Clifford Theorem (Theorem [1]) , there is a positive 
joint (global) MRF consistent with the conditional distributions induced by the 
scheme. Hence, running the Gibbs sampler will always converge, regardless of 
initial conditions. Because the playing procedure is equivalent to running the 
Gibbs sampler (Property CD) , the corresponding empirical distribution of play 
will always converge to the same Gibbs distribution with potential T. Thus, 
the procedure will be consistent. 

In the special case of a w-weighted Gibbs-potential game, then each player 
i’s scheme takes the form 

, , , exp {Mi{xi,xx(i))/wi) 

Pi{Xi aww) = ^- Tjm -w—y 

Ex' ex P( M i( x v x M(i))/ w i) 

which corresponds to an SBR with a (unconditionally) linear transform with 
weight 1/wi. 
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